(12) INTERNATIONAL APPLICATION PUBLISHED UNDER THE PATENT COOPERATION TREATY (PCT) 



(19) World Intellectual Property Organization 
Inlemational Bureau 

(43) International Publication Date 
29 July 2004 (29.07.2004) 




PCT 



llllllllllillllllllillllllilllllllli^ 

(10) International Publication Number 

WO 2004/064293 A3 



(51) Intcriuitional Patent Classilicalion : G()6F 17/30 

(21) International Application Number: 

PCTAJS2004/000302 

(22) International FiUng Date: 8 January 2004 (08.0 1 .2004) 

(25) FiUng Language: English 

(26) Publication Language: English 

(30) Priority Data: 

60/439,330 9 January 2003 (09.01.2003) US 

10/418,949 18 April 2003 (18.04.2003) US 

10/418,739 18 April 2003 (18.04.2003) US 

60/488,367 15 July 2003 (15.07.2003) US 

10/655,496 3 September 2003 (03.09.2003) US 

(71) Applicant: KALEIDESCAPE, INC. [US/US]; 339 North 
i Bernardo Avenue, Suite 100, Mountain View, CA 94043 
I (US). 

I (72) Inventors: RECHSTEINER, Paul; 109 Front Street E., 
I ApARTMENT 627, Toronto, ON MSA 4P7 (CA). NEELY, 



Shawn, R.; 807 West Remington Drive, Sunnyvale, CA 
94087 (US). KESTELOOT, Lawrence; 690 Pennsylva- 
nia Ave. #217, San Francisco, CA 94107 (US). MAL- 
COLM, Michael, A.; P.O. Box 7667, Aspen, CO 81612 
(US). WATSON, Stephen; 65 Clinton Street, Toronto, On- 
tario M6G 2Y4 (CA). 
(74) Agents: SWERNOFSKY, Steven, A. et al.; Swernof- 
sky Law Group_PC, P.O. Box 390013, Moutain View, CA 
94039-0013 (US). 
(81) Designated States (unless otherwise indicated, for every 
kind of national protection available): AE, AG, AL, AM, 
AT, AU, AZ, BA, BB, BG, BR, BW, BY, BZ, CA, CH, CN, 
CO, CR, CU, CZ, DE, DK, DM, DZ, EC, EE, EG, ES, H, 
GB, GD, GE, GH, GM, HR, HU, ID, IL, IN, IS, JP, KE, 
KG, KP, KR, KZ, LC, LK, LR, LS, LT, LU, LV, MA, MD, 
MG, MK, MN, MW, MX, MZ, NA, NT, NO, NZ. OM, PG, 
PH, PL, PT, RO, RU, SC, SD, SB, SG, SK, SL, SY, TJ, TM, 
TN, TR, TT, TZ, UA, UG, US, UZ, VC, VN, YU, ZA, ZM, 
ZW. 

(84) Designated States (unless other^'ise indicated, for every 
kind of regional protection available): ARIPO (BW, GH, 

[Continued on next page] 



\ (54) Title: BOOKMARKS AND WATCHPOINTS FOR SELECTION AND PRESENTATION OF MEDIA STREAMS 



RE: BOOKMARK 



DETERMINE 
ENTRY LOCATION 



DETERMINE 



STATE- 

HI 



J ASSOCIATE WITH 



INFORMATION 
RE: BOOKMARK 



DETERMINE 
IF TRIGGERED 



(57) Abstract: Selection and presentation of media streams, in 
which presentation is not limited by order imposed by the dig- 
ital content representative of those media streams, in response 
to bookmarks (21 1) and watchpoints settable and usable by a 
user. Bookmarks reference a location within the media stream, 
not necessarily pre-selected and possibly dynamically selected, 
in which a presentation can be started or restarted therefrom. 
Watchpoints reference a location within the media stream, or a 
presentation state for the media stream, in which an action can be 
triggered thereby. Bookmarks and watchpoints provide a gen- 
eral technique for presenting selections from media s 
respKinse to metadata. 



< 



RE: BOOKMARK 

I 

CHANGE STATE 
OF PRESENTATION 
DEVICE J 



TRIGGERED 



J DO CONSEQUENT 



o 



wo 2004/064293 A3 lieilllllllllillllllllllllllllKlliyiiiillHIIIIIIi 



GM, KE, LS, MW, MZ, SD, SL, SZ, TZ, UG, ZM, ZW), 
Eurasian (AM. AZ, BY, KG, KZ, MD, RU, TJ, TM), Euro- 
pean (AT, BE, BG, CH, CY, CZ, DE, DK, EE, ES, FI, FR, 
GB, GR, ^ru, IE, IT, LU, MC, NL, PT, RO, SE, SI, SK, 
TR), OAPl (BF. BJ, CF, CG, CI, CM, GA, GN, GQ, GW, 
ML, MR, NE, SN, TD, TG). 
Declarations under Rule 4.17: 

— as to applicant's entitlement to apply for and be granted a 
patent (Rule 4.l7(ii)) for all designations 

— as to the applicant's entitlement to claim the priority of the 
earlier application (Rule 4.17(iii)) for all designations 

— as to the applicant's entitlement to claim the priority of the 
earlier application ( Rule 4. 1 7( Hi)} for all designations 

— as to the applicant's entitlement to claim the priority of the 
earlier application (Rule 4. 1 7(iii)) for all designations 



— as to the applicant's entitlement to claim the priority of the 
earlier application ( Rule 4. 1 7( Hi)) for all designations 

Published: 

— with international search report 

— before the expiration of the time limit for amending the 
claims and to be republished in the event of receipt of 
amendments 

(88) Date ol' publication of tlie international searcli report: 
26 January 2006 

For two-letter codes and other abbreviations, refer to the "Guid- 
ance Notes on Codes and A bbreviations " appearing at the begin- 
ning of each regular issue of the PCT Gazette. 



INTERNATIONAL SEARCH REPORT 



International application No. 
PCT/US04/00302 



A. CLASSIFICATION OF SUBJECT MATTER 
IPC(7) : Cos F ^=t/30 

USCL 707/1U4.1 
According to International Patent Classification (IPC) or to both national classification and IPC 

B. FIELDS SEARCHED 

Minimum documentation searched (classification system followed by classification symbols) 

U.S. : 707/10,1.104.1 



Documentation searched other than minimum documentation to the extent that such documents are included in the fields searched 



Electronic data base consulted during the international search (name of data base and, where practicable, search terms used) 
USPAT 



Category * 


Citation of document, with indication, where appropriate, of the relevant passages 


Relevant to claim No. 


X.P 


US 2003/0126599 Al (NOVAK etal ) 03 JULY 2003 (03.07.2003), whole document. 


1-8,10,14-26.28-31.43- 






64,66-74 


. Y,P 










9.11-13.27,65,32-36 


Y 


US 6,349,143 Bl (HASTINGS et al ) 19 FEBRUARY 2002 (19.02.2002), col.3, lines 35- 


32-36 


Y,P 


40. 

US 2003/0191738 Al (HOEYE et al) 09 OCTOBER 2003 (09. 10.2003), parg. 28. 


27,65 


E,X 


US 6,889,383 Bl (JARMAN) 03 MAY 2005 (03.05.2005), whole document. 


1-74 


E,Y 


US 2004/0166915 Al(ROBARGE) 26 AUGUST 2004 (26.08.2004), pargs. 15, 33,36, 


1-74 




39,41. 




E.Y 


US 2005/0004873 Al (POU et al ) 06 January 2005 (06.01.2005), parg. 27. 


1-74 


E,Y 


US 2004/0166484 Al (BUDKE et al ) 26 AUGUST 2004 (26.08.2004), parg. 41,83 


1-74 


Y.P 


US 2003/0030752 Al (BEGEJA et al) 13 FEBRUARY 2003 (13.02.2003). parg. 43. 


11-13 



Further documents are listed in the continuation of Box C. 



□ 



See patent family a 



Special categories of cited 

menl defining the general state o{ the art which is not considered to b 
uticular relevance 

erapplicatloa or patent published on or after the international filing 



at which may throw doubts on priority claim(s) or which is cited to 
establish the publication dale of another citation or other special reason (as 
specified) 

document refeiring to an oral disclosure, use, exhibition or other means 
:o the international fiUng date but Inter than the 



later document published after the international filing d: 
date and not in canflicl with the application but cited lo 
the principle or theory underlying the invention 



step when ihe document is taken alone 



irticular relevance; llie clauned invention cannot be 
considered to involve an inventive step when the document is 
combined with one or more other such documents, such combination 
bemg obvious lo a person skilled in the art 

document member of the same patent family 



Date of the actual completion of the international search 
22 June 2005 (22.06.2005) 



Date of mailing of the international search report 



Name and mailing address of Ihe ISA/US 
Mail Stop PCT. Attn: ISA/US 
Cominissioaer for Patents 
P.O. Box 1450 

Alexandria, Virginia 223 13-1450 
Facsimile No. (703) 305-3230 



Authorized officer 
John Breene 
Telephone No. 703-305-3900 



Form PCT/ISA/210 (second sheet) (January 2004) 



INTERNATIONAL SEARCH REPORT 



International application No. 
PCT/US04/00302 



C. (Continuation) DOCUMENTS CONSIDERED TO BE RELEVANT 



Category * 


Citation of document, with indication, where appropriate, of the relevant passages 


Relevant to claim No. 


Y.P 
Y,P 


US 2003/0 163466 Al (RAJARAMAN et al ) 28 AUGUST 2003 (28.08.2003). parg.4 
US 2003/0163430 Al (TAKAKU) 28 AGUST 2003 (28.08.2003). parg. 28. 


33 
9 



Form PCT/ISA/210 (continnation of second sheet) (January 2004) 



INTERNATIONAL SEARCH REPORT 



International application No. 
PCTAJS04/00302 



Box No. II Observations where certain claims were Found unsearchable (Continuation of item 2 of first sheet) 



This international search report has not been established in respect of certain claims under Article 17(2)(a) for the following reasons: 



□ 



□ 



□ 

6-4(a). 



Claims Nos.: 

because they relate to subject maner not required to be searched by this Authority, namely: 



Claims Nos. : 

because they relate to parts of the international application that do not comply vvitli the prescribed requirements to 
such an extent that no meaningful international search can be carried out, specifically: 



Claims Nos.: 

because they arc dependent claims and are not drafted in accordance with the second and third sentences of Rule 



Box No. in Observations where imity of invention is lacking (Continuation of item 3 of first sheet) 

This International Searching Authority found multiple inventions in this international application, as follows: 
Please See C ontinuation Sheet 



□ 
□ 
□ 



As all required additional search fees were timely paid by the applicant, this international search report covers all 
searchable claims. 

As all searchable claims could be searched without effort justifying an additional fee, this Authority did not invite 
payment of any additional fee. 

As only some of the required additional search fees were timely paid by the applicant, this international search report 
covers only those claims for which fees were paid, specifically claims Nos.: 



I/nJ No required additional search fees were timely paid by the applicant. Consequently, this international search report is 
restricted to the invention first mentioned in the claims; it is covered by claims Nos.: 1-36 and 43-74 

Remark on Protest The additional search fees were accompanied by the applicant's protest. 

□ 

No protest accompanied the payment of additional search fees. 



Form PCT/ISA/210 (continuation of first sheet(2)) (January 2004) 



INTERNATIONAL SEARCH REPORT 



International application No. 
PCT/US04/00302 



BOX ni. OBSERVATIONS WHERE UNITY OF INVENTION IS LACKING 

This application contains the following inventions or groups of inventions which are not so linked as to form a single general inventive 
concept under PCT Rule 13.1. In order for all inventions to be examined, the appropriate additional examination fees must be paid. 

Group I, claim(s) 1-36, 43-74 drawn to presentation of media streams whereby a bookmark and watchpoint designates a film clip, the 
Qlm clip capable of being presented. 

Group n, claim(s) 37-42, drawn to sending a media stream to a first recipient and sending a media stream and a bookmark to a second 
recipient. 

Group IE, claim(s) 75-1 12, drawn to a directed graph of presentation for the media streams in which media streams are represented by 
in a directed graph. 



The inventions listed as Groups I-ffl do not relate to a single general inventive concept under PCT Rule 13. 1 because, under PCT Rule 
13 2 they lack the same or corresponding special technical features for the following reasons: the special features Group I is 
presentation of media streams whereby a bookmark and watchpoint designates a film clip, the film clip capable of being presented. The 
special feature of Group R is sending a media stream to a first recipient and sending a media stream and a bookmark to a second 
recipient. The special feature of Group III is a directed graph of presentation for the media streams in which media streams are 
represented by vertices in a directed graph. 

None of these special features are common to the other groups, nor do they correspond to a special feature in the other groups. 
Therefore, unity of the invention is lacking. 



Form PCT/ISA/210 (extra sheet) (January 2004) 



